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(54) Image processing method and image input device, control device, image output device and 
image processing system employing same 



(57) To reliably and simply prevent the output of 
specified image data, a unit to detect a pattern is 
installed in one of the devices in a system consisting of 
an image scanner (1) t control device (2) (a personal 
computer) and printer (3) which are connected consec- 
utively. This pattern detection unit contains a unit which 
detects a specified pattern from the mass of image data 
representing a document Once this pattern has been 



found, either the subsequent image data are altered 
before being output or output of the image data is inter- 
rupted. When the system starts up, the control unit for 
each device checks whether that device, or one of the 
other devices in the system, has a pattern detection unit 
as described above, rf it determines that no device has 
such a unit, it halts operation. 
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Description 

FIELD OF THE INVENTION 

The invention relates to an image processing s 
method by which image data representing a 2-dimen- 
sional object are input and subjected to specified 
processing, and the processed image data are output. 
The invention also relates to an image input device, a 
control device, an image output device and an image 10 
processing system in which this method is employed. 

BACKGROUND OF THE INVENTION 

In recent years, copy machines have been devel- 15 
oped which can read a document, such as a color pho- 
tograph, and generate a high-quality copy in which the 
colors are accurately reproduced. Such copy machines 
are now used for a wide variety of applications. 

However, the resolution of these copy machines is 20 
high enough that someone might think it worthwhile to 
try to run off multiple copies of bank notes, stock certifi- 
cates, or other documents which may not be legally 
reproduced. To prevent such one-touch counterfeiting, it 
has been suggested (Patent Publication 2-210481) that 25 
copy machines should be given the capability of recog- 
nizing a characteristic pattern on non-reproducible doc- 
uments so that copies of such documents will not be 
output. 

Figure 28 shows the general configuration of a 30 
device to provide the capability to prevent copying 
described above. It consists primarily of image genera- 
tion unit 50, control unit 51 , image formation unit 52 and 
pattern detection unit 53. 

The aforesaid image generation unit 50 consists of 35 
an image scanner which reads the document and gen- 
erates red (Ft), blue (B) and green (G) image data. Con- 
trol unit 51 inputs these image data and converts them 
to yellow (Y), magenta (M), cyan (C) and black (K) 
image data which can be used in image formation unit 40 
52. Image formation unit 52 accepts the converted 
image data and transcribes them. 

Pattern detection unit 53 determines whether the 
image data generated by image generation unit 50 con- 
tain the characteristic pattern which identifies a non- 45 
reproducible document. The result of this determination 
is output to control unit 51. When control unit 51 
receives from unit 53 the result that the characteristic 
pattern has been found, it outputs a control signal 
(shown in the drawing by dotted lines) to image forma- so 
tion unit 52 or image generation unit 50 to cease oper- 
ating. With this method, the generation or output of 
image data identified by the characteristic pattern will be 
interrupted, and the copying operation will be halted or 
the entire surface of the copy which is output will be cov- 55 
ered with a particular color. 

Recently, printers have been developed which are 
capable of outputting highly accurate color images. Now 
anyone with an image scanner, a personal computer 



and a printer can easily make reproductions of color 
documents which are as accurate as those of high-res- 
olution copy machines. For this reason a demand has 
sprung up for a device which could be installed in such 
a system to prevent the reproduction of specified image 
data and thereby prevent the system from being used 
for unlawful copying. 

SUMMARY OF THE INVENTION 

The present invention addresses the problems dis- 
cussed above. One objective is to provide a device 
which would be able to recognize a characteristic pat- 
tern in a document's image data and control the output 
of image data based on the result of this recognition. 
This would be a simple and reliable way to prevent the 
output of specified image data. 

Another objective of this invention is to provide a 
device able to determine whether there is a means 
either in the system or connected to it which could 
detect specific image data as described above and con- 
trol the output of image data. If it is determined that 
there is no such device, it would partially or completely 
halt the function of the system so that output of the spe- 
cific image data would be completely arrested. 

In one embodiment of the present invention, the 
image data to be processed are color image data con- 
sisting of the combination of image data associated with 
a number of color signals which are input successively. 

In another embodiment of the present invention, the 
specified pattern is detected as follows. For each color 
signal, all image data except those which will be input 
last are stored separately. When the final data are input, 
an image created by combining these data with all the 
aforesaid image data which have been stored is com- 
pared with a reference pattern. 

In still another embodiment of the present inven- 
tion, the method is implemented by a device which 
detects a specified pattern. This device consists of: a 
device to store separately all image data for each color 
signal except those data which are to be input last; a 
device to compare with a reference pattern an image 
created by combining, when the last image data have 
been input, the final input data with all the image data 
stored in the aforesaid storage device; and a device to 
determine, based on the result of the comparison per- 
formed by the aforesaid comparison device, whether 
the aforesaid specified pattern can be found in the 
image data being processed. 

In another embodiment of the present invention, the 
image data for the different color signals are succes- 
sively compared with a reference image. The result of 
the comparison for each color signal is stored, and the 
results of all the comparisons are cumulated to detect 
the specified pattern. 

In another embodiment, the aforesaid means of 
detecting a specified pattern consists of: a device to 
compare the image data for each color signal to a spec- 
ified reference pattern; a device to store for each color 
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signal the result of the comparison performed by the 
aforesaid comparison device; and a device to cumulate 
the results of the comparisons for the different color sig- 
nals which are stored in the aforesaid storage device 
and determine whether the aforesaid specified pattern 5 
can be found in the image data being processed. 

In one embodiment of the present invention, an 
image processing method is employed by which image 
data representing a 2-dimensional object are input and 
subjected to specified processing, and the processed 10 
image data are output. When it becomes clear at some 
point during the aforesaid processing that either the 
processing to determine whether a specified pattern 
can be found in the image data or the processing to con- 
trot the output of image data according to the result of is 
the determination will not be executed, the image 
processing function is partially or completely halted. 

Another embodiment of the present invention is a 
system to implement the processing method described 
above, consisting of: a device which detects whether 20 
the system has a means to determine whether a speci- 
fied pattern can be found in the image data being proc- 
essed; a device which detects whether the system has 
a means to control the output of image data based on 
the result of the determination made by the aforesaid 25 
means of detecting a specified pattern; and a device 
which halts the function of the system either partially or 
completely when the first of the aforesaid detection 
devices delects that the system has no means to deter- 
mine whether a specified pattern can be found in the 30 
image data being processed, or when the second of the 
aforesaid detection devices detects that the system has 
no means to control its output 

Other embodiments concern devices used to input 
image data representing a 2-dimensional object. These 35 
input devices have a means to determine whether a 
specified pattern can be found in the image data being 
processed and a means to control the output of image 
data based on the result of the determination made by 
the means of detecting a specified pattern. The image 40 
data which are to be processed are color image data 
consisting of the combination of image data associated 
with a number of color signals which are input succes- 
sively. 

In one embodiment the aforesaid means of detect- 45 
ing a specified pattern consists of: a device to store sep- 
arately all image data for each color signal except those 
data which are to be input last; a device to compare with 
a reference pattern an image created by combining, 
when the last image data have been input, the final so 
input data with all the image data stored in the aforesaid 
storage device; and a device to determine, based on the 
result of the comparison performed by the aforesaid 
comparison device, whether the aforesaid specified pat- 
tern can be found in the image data being processed. ss 

In another embodiment, the aforesaid means of 
detecting a specified pattern consists of: a device to 
compare the image data for each color signal to a spec- 
ified reference pattern; a device to store for each color 



signal the result of the comparison performed by the 
aforesaid comparison device; and a device to cumulate 
the results of the comparisons for the different color sig- 
nals which are stored in the aforesaid storage device 
and determine whether the aforesaid specified pattern 
can be found in the image data being processed. 

In still another embodiment, an image input device 
identical to that described above has, either integral to 
itself or in a device connected to it, a means to deter- 
mine whether the system has a device which detects a 
specified pattern in the image data being processed 
and a device which controls data output based on the 
result of the detection made by the device to detect a 
specified pattern; and a means to halt the function of the 
device either partially or completely when the aforesaid 
determination device has determined that the system 
lacks either the aforesaid device to detect a pattern or 
the device to control the output. 

Other embodiments concern a control device which 
executes specified processing on image data represent- 
ing a 2-dimensional object or a device to output image 
data representing a 2-dimensional object. 

In other embodiments of the present invention, an 
image created by combining the input data with image 
data entered previously and stored is compared with a 
reference pattern when the final image data are input. In 
this way it can be determined whether the image con- 
tains the specified pattern. This method makes it possi- 
ble to execute pattern detection processing on an image 
created by successively combining image data for mul- 
tiple color signals. 

In some embodiments, the image data for the each 
color signal are compared with a reference image at the 
time they are generated. The result of the comparison 
for each color signal is stored, and the results of all the 
comparisons are cumulated to determine whether the 
data contain the specified pattern. This method makes it 
possible to execute pattern detection processing on a 
color image created by successively combining image 
data for multiple color signals. 

Finally, in some embodiments of the present inven- 
tion, when the function of detecting the pattern or the 
function of controlling the output of image data are not 
present, the function of the system is partially or com- 
pletely halted. Thus, if someone should substitute some 
other device for the device which detects a pattern or 
controls the output, the function of that other device will 
be halted and it will become impossible to output image 
data for the document. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 illustrates the configuration of an image 
processing system designed according to this invention. 

Figure 2 is a block diagram of an image scanner in 
which a pattern detection unit has been installed. 

Figure 3 is a block diagram of the pattern detection 

unit 

Figure 4 illustrates how the color image data are 
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generated. 

Figure 5 shows an example of a document which 
may not lawfully be copied. 

Figure 6 illustrates the method used to search for 
the pattern of the mark. 5 

Figure 7 shows examples of image data which are 
output when the pattern detection unit shown in Figure 
3 is used. 

Figure 8 is a block diagram of another pattern 
detection unit. 10 

Figure 9 shows another method to generate color 
image data. 

Figure 10 is a block diagram of another pattern 
detection unit. 

Figure 11 is a block diagram of another pattern is 
detection unit. 

Figure 12 is another example of a document which 
may not lawfully be copied. 

Figure 13 is a block diagram of a control device in 
which a pattern detection unit is installed. so 

Figure 14 is a block diagram of a control device in 
which a pattern detection unit is installed. 

Figure 15 is a block diagram of a control device in 
which a pattern detection unit is installed. 

Figure 16 is a block diagram of a control device in 25 
which a pattern detection unit is installed. 

Figure 17 is a block diagram of a printer in which a 
pattern detection unit is installed. 

Figure 18 is a block diagram of a printer in which a 
pattern detection unit is installed. 30 

Figure 19 is a block diagram of a printer in which a 
pattern detection unit is installed. 

Figure 20 gives an example of the final output of the 
printer. 

Figure 2 1 gives an example of the final output of the 3s 
printer. 

Figure 22 gives an example of the final output of the 
printer. 

Figure 23 gives an example of the final output of the 
printer. 40 

Figure 24 gives an example of the final output of the 
printer. 

Figure 25 gives an example of the final output of the 
printer. 

Figure 26 gives an example of the final output of the 45 
printer. 

Figure 27 is a flow chart of the processing executed 
by the control unit for each device when the system 
starts up. 

Figure 28 is a block diagram of a dedicated copying so 
device. 

DETAILED DESCRIPTION OF THE INVENTION 

Figure 1 illustrates an image processing system ss 
which is an ideal embodiment of this invention. 

This image processing system consists of image 
scanner 1 , control device 2, a personal computer, and 
printer 3, all of which are connected together by an 



SCSI bus or a LAN circuit. 

Image scanner 1 can generate image data in three 
primary colors. The R, G and B data which are gener- 
ated are output in order to control device 2. Control 
device 2 inputs these image data into its internal input 
unit and outputs to printer 3 either RGB or YMCG 
image data, depending on which method it uses. The 
control unit in printer 3 drives the printing head or other 
print processing unit according to the image data it 
receives and copies an image of the document. 

To prevent the copying of documents which have a 
specified mark on them, this image processing system 
has, in either the aforesaid scanner 1, control device 2 
or printer 3, a unit which determines whether the image 
data being processed contain the shape of the afore- 
said mark and which prevents the output of these image 
data to the next stage (hereafter referred to as "the 
image detection unit"). 

This detection unit is formed on a single chip. Build- 
ing this chip into an existing circuit in a device will give 
that device the capability of detecting the aforesaid 
mark. 

If the detection unit is installed in image scanner 1 , 
a pattern detection device R-, to detect pattern must be 
placed between image data generation device 4 and 
image data output device 5, as shown in Figure 2. 
Detection device R 1 determines whether the specified 
, pattern can be found in the image of the document gen- 
erated by image data generation device 4. If it can, the 
image data are converted to a specified pattern and out- 
put to data output device 5. 

Figure 3 shows the configuration of pattern detec- 
tion device R-j. 

In this embodiment, the RGB image data for each 
pixel of an image consisting of n number of pixels P 0 
through P n . 1 (shown in Figure 4 (1)) are input succes- 
sively by image data generation device 4. If a mark 
as shown in Figure 5 is found in these image data, the 
document will be treated as non-reproducible. 

The aforesaid detection device R.j contains line 
memories 6 R , 6 G and 6 B , which store the image data for 
each color signal; image alteration unit 7; pattern detec- 
tion unit PT-, ; and selector 8. 

Each of line memories 6 Rt 6 G and 6 B has a buffer 
which corresponds to the size of the specified pattern 
M v The RGB image data for each pixel are transmitted 
by way of line memories 6 R , 6 G and 6 B to image altera- 
tion unit 7 and selector 8. 

Image alteration unit 7 alters the image data it 
receives by painting over them in a specified pattern. 
Selector 8 selects either the original image data from 
line memories 6 R , 6 G and 6 B or the altered image data 
and outputs them to image data output device 5. 

Detection unit PT-, comprises primarily of pattern 
search unit 9; pattern extraction unit 10; line memories 
11r. 11 g and 11 B ; pattern matching unit 12; and refer- 
ence memory 13. The image data for each color signal 
transmitted by image data generation device 4 are input 
into search unit 9 and line memories 11 R , 11 Q and 11 B 
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in synchronization with their input into the line memories 
6 R , 6q and 6 B . 

Pattern search unit 9 extracts from the image data 
which have been input the pattern corresponding to the 
upper arc of the circle in the mark As can be seen in s 
Figure 6, pattern search unit 9 uses the arc pattern cp 
which it has extracted to calculate the coordinates of the 
center point 0 of the entire pattern, It outputs these 
coordinates to pattern extraction unit 10. 

Like the first set of line memories 6 R . 6q and 6b, io 
line memories 1 1 R , 1 1 G and 1 1 B correspond to the size 
of mark M v Based on the coordinates of the center 
point 0, pattern extraction unit 10 specifies the pixels in 
each of line memories 11 Rl 11 G and 11 B which corre- 
spond to the pattern of mark M and extracts the image is 
data of each color signal which belong to that pattern. 
Pattern matching unit 12 calculates the correlation 
between the extracted pattern and a reference pattern 
for mark M 1t which is previously stored in reference 
memory 13. It outputs the goodness of fH which is the 20 
result of this calculation to selector 8. 

Ordinarily, selector 8 selects the original image data 
output by line memories 6 R , 6 Q and 6 B and outputs 
them to image data output device 5. When matching 
unit 12 inputs a goodness of fit which exceeds a speci- 25 
fied threshold value, selector 8 substitutes the altered 
image data from image alteration unit 7. 

The alteration processing executed by image alter- 
ation unit 7 is not limited to painting over the image data 
in a specified way. Unit 7 might as an alternative gradu- 30 
ally decrease the density value of the image data which 
are being input. 

With the processing described above, as shown in 
Figures 7 (1) and (2), all of the image beyond mark M 1( 
regardless of whether the image is being scanned from 35 
top to bottom or bottom to top, is painted over before it 
is output. If control device 2 synthesises the results of 
scanning the document from both directions, as shown 
in Figure 7 (3), the portion of the image where mark M 1 
is located will still not be reproduced. 40 

If line memory 6 is provided with a buffer corre- 
sponding to the size of the entire image, the image data 
for the entire document can be altered before they are 
output. 

Figure 8 shows another ideal embodiment of pat- 45 
tern detection device Rf. 

In this embodiment, the image data for three pri- 
mary color signals generated by image data generation 
device 4 are input successively as portions of the frame 
(shown in Figure 9). Pattern detection unit PT 2 has the so 
same configuration as detection unit PT-, in Figure 3, to 
which has been added switching unit 14 and line mem- 
ories 15 R and 15q. 

Pattern detection device R 1 inputs the image data 
for all three color signals frame unit by frame unit. This ss 
being the case, common line memories 6 and 1 1 store 
all three colors for image output and pattern detection. 

The image memories 15 R and 15q store one 
frame's worth of image data for each of R and G: Rq 



through R n . ^ and Gq through Gn . t . When these image 
data are input, switching unit 14 switches their destina- 
tion between image memories 15 R and 15q. 

When the B image data, B 0 through Bp . , , are input, 
switching unit 14 switches their destination between 
search unit 9 and line memory 1 1 . Pattern search unit 9 
combines the B data which are input with the R and G 
data stored in the aforesaid image memories 15 R and 
ISq. Executing the same processing as is described 
above, it extracts the center point of the pattern corre- 
sponding to mark M 1 and outputs these coordinates to 
pattern extraction unit 10. 

Based on the coordinates it receives from pattern 
search unit 9, pattern extraction unit 10 reads out of line 
memory 1 1 and image memories 15 R and 15 Q the RGB 
image data representing the pattern of mark Mj . Match- 
ing unit 12 calculates the correlation between the pat- 
tern formed by the data which are read out and a 
reference pattern. It outputs the goodness of fit which is 
the result of this calculation to selector 8. 

The image data generated by image data genera- 
tion device 4 are input successively into line memory 6. 
The original image data in line memory 6 which are 
associated with image data Rq through R n . 1 and Gq 
through G n . ^ are output successively by way of selector 
8 and image data output device 5 to control unit 2. 

When the final B image data are input, as dis- 
cussed earlier, pattern detection unit PT 2 executes the 
processing to detect the pattern of mark When the 
resulting goodness of fit which is input by matching unit 
12 into selector 8 exceeds a specified threshold value, 
selector 8 switches the output designation to the data 
altered by image alteration unit 7. 

With this processing, once the pattern of mark M-) is 
detected, the B image data input into control device 2 
are reconformed into a specified pattern. Even if control 
device 2 combines these B data with the previously 
input R and G data, it will not be possible to reproduce 
an image of the document. 

Figure 10 shows another ideal embodiment of pat- 
tern detection device R-) . 

This embodiment executes the same processing as 
the device shown in Figure 8 above. However, as the 
stage prior to switching unit 14, pattern detection unit 
PT 3 has a preprocessor unit 16, which reduces the vol- 
ume of data by thinning out or binarizing the image data. 
In place of the aforesaid image memories 15 R and 15q ( 
PT 3 has image memories 1 5 R * and ISq, which store the 
image data which have been processed by preproces- 
sor unit 16. 

Since the other components of PT 3 are identical to 
those shown in Figure 8, they are not described again. 

Figure 1 1 shows another ideal embodiment of pat- 
tern detection device R^ 

This embodiment is also designed to handle image 
data input by image data generation device 4 according 
to the method shown in Figure 9 above. Pattern detec- 
tion unit PT 4 has the same pattern search unit 9, pattern 
extraction unit 10, line memory 1 1 and pattern matching 
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unit 12 as described above. It has three reference mem- 
ories, 16 R , 16 G and 16 B , which store reference patterns 
for the three color signals, a storage unit 17 for good- 
ness of fit and a pattern detection unit 18. 

Image data for the three primary colors are input 
successively into pattern search unit 9 and line memory 
11. The patterns representing mark M«j in each color 
signals are extracted and matched against each color 
signal of a reference pattern, and the goodness of fit is 
calculated. The goodness of fit which have been calcu- 
lated are stored in storage unit 1 7. When the B data 
have been input and the final matching process is com- 
pleted, pattern detection unit 18 reads out all three 
goodness of fit values from storage unit 17 and makes 
an overall determination, the result of which it outputs to 
selector 8. 

Just as in the embodiments pictured in Figures 8 
and 10, selector 8 selects from line memory 6 the origi- 
nal image data for R and G and outputs them. If, when 
the B data are input, a determination is input to the 
selector unit 8 that the pattern representing mark M-, 
has been found, selector 8 switches the output designa- 
tion to the data altered by image alteration unit 7. 

With the configuration described above, if mark 
can be specified by a given color signal (red), the deter- 
mination made when the image data for that signal (in 
this case, the R data) have been input can also be used 
to cause selector 8 to switch the output data. 

We shall next discuss two embodiments in which 
the pattern detection unit is built into control device 2. 

In the following embodiments, we assume that the 
non-reproducible document has a mark M 2 like that 
shown in Figure 12. 

Figures 13 and 14 show embodiments in which 
detection device R 2 is placed on the route leading to 
image input unit 20 in control device 2. The pattern 
detection unit PT in these embodiments has the same 
configuration as one of units PT 1 through PT 4 , depend- 
ing on what method image scanner 1 uses to output its 
image data. 

In Figure 13, if the specified pattern is found in the 
image data input from image data output device 5 of 
image scanner 1 , the image data sent to input unit 20 
will be altered. Pattern detection device R 2 has an 
image alteration unit 7 and a selector 8 in addition to 
detection unit PT. 

The image data from image scanner 1 are input 
simultaneously into pattern detection unit PT, image 
alteration unit 7 and selector 8. Detection unit PT deter- 
mines, using any of the embodiments described above, 
whether image data input by the scanner 1 contain the 
specified pattern. The result of this determination is out- 
put to selector 8. Depending on the result of the deter- 
mination, selector 8 selects either the original image 
data or the data altered by image alteration unit 7 and 
outputs them to image input unit 20. 

Figure 14 shows an embodiment in which pattern 
detection device R 3 halts the intake of image data by 
image scanner 1 . In this case pattern detection device 



R 3 consists of input path L, along which the original 
image data from image scanner 1 are input to image 
input unit 20, and pattern detection unit PT. The result of 
the detection by unit PT is output to image input unit 20 

5 and scanner control unit 19. 

When pattern detection unit PT outputs the result 
that the image data input from image scanner 1 contain 
the specified pattern, scanner control unit 19 outputs to 
the intake portion of image scanner 1 a control signal to 

io halt intake. At the same time, image input unit 20 exe- 
cutes processing to invalidate the image data which 
have been read and communicates to a control unit, not 
pictured, the fact that there is a defect in the reading of 
the image data. 

15 In both the above embodiments, the pattern detec- 
tion unit is inserted on the path along which the image 
data from image scanner 1 are input. However, it would 
also be possible to install the detection unit on the path 
along which the image data are output to printer 3. 

20 Figure 15 has a pattern detection unit identical to 
that in Figure 1 3 installed on the output path to printer 3. 
When the specified pattern is found in the image data to 
be output, the image data are altered before being out- 
put to printer 3. In this case, pattern detection device R 2 

25 inputs and processes either the RGB image data or the 
YMCK image data converted by image data converting 
unit 22, depending on the configuration of the printer 3 
to which it is connected. 

Figure 16 has a pattern detection unit identical to 

30 that shown in Figure 14 installed on the output path to 
printer 3. The result of the determination made by pat- 
tern detection unit PT is fed back to printer control unit 
21. In this case, when pattern detection unit PT deter- 
mines that the image data to be output contain the spec- 

35 if ied pattern, printer control unit 21 outputs a halt signal 
to the printer 3, and the print operation is terminated. 

We shall next discuss several embodiments in 
which the pattern detection unit is installed in printer 3. 
The printer 3 shown in Figure 17 inputs the YMCK 

40 image data from control device 2 into print control unit 
24 by way of interface circuit 23. Print control unit 24 
transmits the image data to print processing unit 25, and 
controls the print operation of print processing unit 25 
from start to finish. A pattern detection device R^ iden- 

45 tical to that in Figure 13 or 15, is installed on the path 
along which image data are output from print control 
unit 24 to print processing unit 25. 

In Figure 18, a pattern detection device R 3 , identi- 
cal to that in Figure 14 or 16 above, is installed on the 

so path along which image data are output from print con- 
trol unit 24 to print processing unit 25. The result of the 
determination made by detection unit PT is fed back to 
print control unit 24. In this case, when detection unit PT 
determines that the image data to be output contain the 

55 specified pattern, print control unit 24 outputs a halt sig- 
nal to print processing unit 25, and the print operation is 
interrupted. 

Figure 19 shows another example of how the pat- 
tern detection unit can be incorporated in the design. 
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The printer in this embodiment is configured so that 
the image data from interface circuit 23 are input into 
print processing unit 25 by way of buffer 26. A pattern 
detection device R 3 , identical to that in Figure 18, is 
placed between interface circuit 23 and buffer 26. Out- 5 
put adjustment unit 27 is placed between print control 
unit 24 and print processing unit 25. 

The image data from interface circuit 23 are input 
simultaneously into buffer 26 and pattern detection unit 
PT. Detection unit PT uses the same method described 10 
above to determine whether the image data contain the 
specified pattern. The result of this determination is out- 
put to print control unit 24 and output adjustment unit 
27. 

Ordinarily, the output adjustment unit 27 outputs the is 
image data it receives through buffer 26 to print control 
unit 25 without further treatment, in response to a con- 
trol signal from print control unit 24. However, when it 
receives a determination from the pattern detection unit 
that the image data to be output contain the specified 20 
pattern, it alters the image data from buffer 26. When 
print control unit 24 receives the same determination 
result, it outputs a control signal to output adjustment 
unit 27 to cease its operation. The operation of print 
processing unit 25 is immediately hatted. 25 

Figures 20 through 24 give five examples of the 
copy which is output by printer 3 in the embodiments 
which employ the aforesaid pattern detection device R 2 
(Figures 13, 15 and 17). 

Figure 20 shows a case in which the image data 30 
beyond the point where mark M 2 is detected have been 
transformed into a specified pattern. Every part of the 
document which is output beyond mark M 2 is covered 
over with this pattern. In Figure 21 , the image data are 
altered to gradually decrease the density of the portion 35 
of the image beyond mark M 2 . The image in the copy 
gradually gets lighter until it disappears. 

Figures 22 through 24 give examples in which 
printer control unit 21 in control device 2 or print control 
unit 24 in printer 3 supplements the altered data with 40 
additional image data before the copy is output. In the 
example shown in Figure 22, the margin of the docu- 
ment has also been printed with a cover pattern. In the 
example in Figure 23, a specified warning has been 
printed over the covered portion of the image. In the 45 
example in Figure 24, the print in the image gradually 
gets lighter just as in Figure 21 , and a warning is printed 
in the margin. 

Figure 25 is an example of a copy output by an 
embodiment with the aforesaid detection device R 3 so 
(Figures 14, 16, 18 and 19). The printing of the image is 
interrupted when mark M 2 is discovered, and the rest of 
the document remains blank. 

In this case, too, as is shown in Figure 26. a warn- 
ing may be printed in a specified location on the copy. ss 

Like device R 1( the aforesaid pattern detection 
devices R 2 and R 3 have line memories corresponding to 
the size of mark M 2 . If the image data are delayed in 
these line memories before being output, the output of 
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the image data containing mark M 2 can be controlled. 

In the image processing systems described above, 
devices R 1 through R 3 , which have a specified circuit 
pattern, are built into existing circuitry in one of the sys- 
tem devices. This design significantly reduces the labor 
and cost required to develop a system. If the user is free 
to store any desired reference pattern in the reference 
memory in detection unit PT, he can freely designate or 
change the document to be prohibited. 

This image processing system consists of three 
general purpose devices, image scanner 1, control 
device 2 and printer 3, which are connected together. It 
would be easy, then, to disable the system by removing 
the device (for example, the image scanner) with the 
detection unit and substituting another device without 
such a unit. 

To address this problem, the image processing sys- 
tem has the control unit for every device in the system 
verify, at the time the system starts up, that the device or 
some other system device has a pattern detection unit, 
ff a control unit recognizes that there is no detection 
unit, it orders that the operation of the device be halted. 

Figure 27 shows the control operation executed by 
the control unit for each device when the system starts 
up. 

Every control unit checks in Step 1 whether its 
device has a pattern detection unit. If the answer is "no", 
it checks in Step 2 whether any other device has a 
detection unit. 

If the devices are connected by an SCSI bus, they 
can be checked successively in the order of their ID 
numbers. If they are connected by a LAN circuit, all the 
devices can be checked simultaneously. 

If the answer in Step 1 or Step 2 is "yes*, the control 
unit for each device starts up its main program to render 
it operable (Step 3). If the answer is "no" in Steps 1 and 
2, each control device executes processing to hart oper- 
ation and control device 2 outputs an audio warning 
(Step 4). 

In the embodiments described above, when it is 
determined that there is no detection unit in any of the 
devices, the operation of each device is interrupted. 
Alternatively, the devices themselves may be allowed to 
operate while only the input or output of image data is 
halted. 

In the embodiments discussed above, we assumed 
that the document reproduction system consisted of 
image scanner 1 , control device 2 and printer 3. This 
invention, however, is not limited to the aforesaid sys- 
tem only. It could be applied in any system consisting of 
interconnected devices to input, output and process 
image data. 

For example, a storage device such as a hard disk, 
a floppy disk or a CD driver can be connected to two or 
more control devices, ff any of these storage or control 
devices has a pattern detection unit and someone tries 
to make a copy of a storage medium on which image 
data are stored, any image data marked with the speci- 
fied pattern can be prevented from being copied. 
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If there is a detection unit in one of the devices in a 
system in which a modem is connected to a control 
device to transmit image data read by a scanner, it will 
not be possible to transmit image data representing 
specified documents. 

This invention, then, can be applied in any com- 
monly used computer system, where it will simply and 
reliably prevent the reproduction of image data associ- 
ated with specified documents. 

In some embodiments of the present invention, the 
pattern detection processing is executed on color image 
data synthesized by successively combining image data 
for each color signal. In this way the output of specified 
color image data can be controlled. 

In other embodiments of the present invention, if 
the function of detecting the pattern or controlling the 
data output is absent, the system is partially or com- 
pletely halted. This will make it impossible to output the 
image data of specified documents even if the device 
providing the pattern detection or control function is 
removed from the system. 

Claims 

1. An image processing method to process a color 
image data having a plurality of color signals which 
are input successively, comprising the steps of: 

storing said plurality of color signals except a 
last color signal separately in line memories; 
extracting a specified pattern from a restored 
color image combining said plurality of color 
signals when said last color signal is input; 
matching said specified pattern against a refer- 
ence pattern to obtain a matching result; and 
controlling an output of said color image data 
depending on said matching result. 



2. An image processing method to process a color 
image data having a plurality of color signals which 
are input successively, comprising the steps of: 

storing said plurality of color signals separately 
in line memories; 

extracting specified patterns from said plurality 
of stored color signals individually; 
matching said specified pattern against a refer- 
ence pattern to obtain a matching result; and 
controlling an output of said color image data 
depending on said matching result. 

3. An image processing method to process a color 
image data having a plurality of color signals which 
are input successively, comprising the steps of: 

verifying that a device detecting if a specified 
pattern exists in said color image data matches 
a reference pattern and a device controlling the 
output of said color image data based on said 
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detection exist in said system; and 

halting said system if either device does not 

exist in said system. 

An image processing system to process an image 
data having an image data generation device to 
input an image data from a 2-dimensional object, a 
control device to process said image data from said 
image data generation device, and an image data 
output device to output said processed image data 
from said control device, comprising: 

a pattern detection device to detect if a speci- 
fied pattern in said image data matches a refer- 
ence pattern, and 

a system control device to control the output of 
said image data depending on said matching. 

An image processing system according to claim 4, 
wherein said control device outputs an altered 
image data based on said matching. 

An image processing system according to claim 4, 
wherein said control device halts the operation of 
said image processing system based on said 
matching. 

An image processing system according to claim 4, 
wherein said pattern detection device comprises: 

a plurality of line memories for separately stor- 
ing a plurality of color signals except a last 
color signal; 

a pattern extraction unit to extract a specified 
pattern from a restored color image combining 
said plurality of color signals when said last 
color signal is input; 

a pattern matching unit to match said specified 
pattern against a reference pattern and obtain 
a matching result; and 

a selector unit to control an output of said 
image data based on said matching result. 

An image processing system according to claim 4, 
wherein said pattern detection device comprises: 

a plurality of line memories for separately stor- 
ing a plurality of color signals; 
a pattern extraction unit to extract specified pat- 
terns from said plurality of stored color signals 
individually; 

a pattern matching unit to match said specified 
patterns against a reference pattern and obtain 
a matching result; and 

a selector unit to control the output of said 
image data based on said matching result. 

An image processing system to process an image 
data having an image data generation device to 
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input an image data from a 2 -dimensional object, a 
control device to process said image data from said 
image data generation device, and an image data 
output device to output said processed image data 
from said control device, comprising: 

a first verifying unit to verify there is a pattern 
detection device in said system which detects if 
a specified pattern in said image data matches 
a reference pattern; 

a second verifying unit to verify there is a sys- 
tem control device in said system which con- 
trols the output of said color image data based 
on said matching; and 

a system halting unit to halt said system par- 
tially or completely if said first verifying unit 
determines there is no said pattern detection 
device or said second verifying device deter- 
mines there is no said system control device. 

10. An image data generation device to input an image 
data from a 2 -dimensional object, comprising: 

a pattern detection device to detect if a speci- 
fied pattern in said image data matches a refer- 
ence pattern, and 

a system control device to control the output of 
said image data based on said detection; 

wherein said image data is combined with a 
plurality of color signals which are input succes- 
sively, and said pattern detection device is compris- 
ing; 

a plurality of line memories for seperately stor- 
ing a plurality of color signals except a last 
color signal; 

a pattern extraction unit to extract a specified 
pattern from a restored color image combining 
said plurality of color signals when said last 
color signal is input; 

a pattern matching unit to match said specified 
pattern against a reference pattern and obtain 
a matching result; and 

a selector unit to control the output of said 
image data based on said matching result. 

1 1 . An image data generation device to input an image 
data from a 2 -dimensional object, comprising: 

a pattern detection device to detect if a speci- 
fied pattern said image data matches a refer- 
ence pattern, and 

a system control device to control the output of 
said image data based on said detection; 

wherein said image data is combined with a 
plurality of color signals which are input succes- 
sively, and said pattern detection device comprises: 



a plurality of line memories fa seperately stor- 
ing said plurality of color signals; 
a pattern extraction unit to extract a specified 
pattern from a color image of said plurality of 
5 color signals individually; 

a pattern matching unit to match said specified 
pattern against a reference pattern and obtain 
a matching result; and 

a selector unit to controD the output if said 
io image data based on said matching result 

12. An image data generation device to input an image 
data from a 2 -dimensional object, comprising: 

is a first verifying unit to verify there is a pattern 

detection device in said system which detects if 
a specified pattern in said image data matches 
a reference pattern; 

a second verifying unit to verify there is a sys- 
20 tern control device in said system which con- 

trols the output of said color image data based 
on said matching; and 

a system halting unit to halt said system par- 
tially or completely if said first verifying unit 
25 determines there is no said pattern detection 

device or said second verifying device deter- 
mines there is no said system control device. 

13. A control device to process said image data from 
30 said image data generation device, comprising: 

a pattern detection device to detect rf a speci- 
fied pattern in said image data matches a refer- 
ence pattern, and 
35 a system control device to control the output of 

said image data based on said detection; 

wherein said image data is combined with a 
plurality of color signals which are input succes- 
40 sively, and said pattern detection device is compris- 
ing: 

a plurality of line memories for seperately stor- 
ing a plurality of color signals except a last 

45 color signal; 

a pattern extraction unit to extract a specified 
pattern from a restored color image combining 
said plurality of color signals when said last 
color signal is input; 

so a pattern matching unit to match said specified 

pattern against a reference pattern and obtain 
a matching result; and 

a selector unit to control the output of said 
image data based on said matching result 

55 

14. A control device to process said image data from 
said image data generation device, comprising: 

a pattern detection device to detect rf a sped- 
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fied pattern said image data matches a refer- 
ence pattern, and 

a system control device to control the output of 
said image data based on said detection; 

wherein said image data is combined with a 
plurality of color signals which are input succes- 
sively, and said pattern detection device comprises: 

a plurality of line memories for seperately stor- 
ing said plurality of color signals; 
a pattern extraction unit to extract a specified 
pattern from a color image of said plurality of 
color signals individually; 
a pattern matching unit to match said specified 
pattern against a reference pattern and obtain 
a matching result; and 

a selector unit to controll the output if said 
image data based on said matching result. 

A control device to process said image data from 
said image data generation device, comprising: 

a first verifying unit to verify there is a pattern 
detection device in said system which detects if 
a specified pattern in said image data matches 
a reference pattern; 

a second verifying unit to verify there is a sys- 
tem control device in said system which con- 
trols the output of said color image data based 
on said matching; and 

a system halting unit to halt said system par- 
tially or completely if said first verifying unit 
determines there is no said pattern detection 
device or said second verifying device deter- 
mines there is no said system control device. 
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An image data output device to output said proc- 
essed image data from said control device, com- 
prising: 40 

a pattern detection device to detect if a speci- 
fied pattern in said image data matches a refer- 
ence pattern, and 

a system control device to control the output of 45 
said image data based on said detection; 

wherein said image data is combined with a 
plurality of color signals which are input succes- 
sively, and said pattern detection device is compris- so 
ing: 



a pattern matching unit to match said specified 
pattern against a reference pattern and obtain 
a matching result; and 

a selector unit to control the output of said 
image data based on said matching result. 

17. An image data output device to output said proc- 
essed image data from said control device, com- 
prising: 

a pattern detection device to detect if a speci- 
fied pattern said image data matches a refer- 
ence pattern, and 

a system control device to control the output of 
said image data based on said detection; 

wherein said image data is combined with a 
plurality of color signals which are input succes- 
sively, and said pattern detection device comprises: 

a plurality of line memories for seperately stor- 
ing said plurality of color signals; 
a pattern extraction unit to extract a specified 
pattern from a color image of said plurality of 
color signals individually; 
a pattern matching unit to match said specified 
pattern against a reference pattern and obtain 
a matching result; and 

a selector unit to controll the output if said 
image data based on said matching result. 

18. An image data output device to output said proc- 
essed image data from said control device, com- 
prising: 

a first verifying unit to verify there is a pattern 
detection device in said system which detects if 
a specified pattern in said image data matches 
a reference pattern; 

a second verifying unit to verify there is a sys- 
tem control device in said system which con- 
trols the output of said color image data based 
on said matching; and 

a system halting unit to hart said system par- 
tially or completely if said first verifying unit 
determines there is no said pattern detection 
device or said second verifying device deter- 
mines there is no said system control device. 



a plurality of line memories for seperately stor- 
ing a plurality of color signals except a last 
color signal; 

a pattern extraction unit to extract a specified 
pattern from a restored color image combining 
said plurality of color signals when said last 
color signal is input; 
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